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We provide an overview on superstatistical techniques applied to complex systems with time 
scale separation. Three examples of recent applications are dealt with in somewhat more detail: 
the statistics of small-scale velocity differences in Lagrangian turbulence experiments, train delay 
statistics on the British rail network, and survival statistics of cancer patients once diagnosed with 
cancer. These examples correspond to three different universality classes: Lognormal superstatistics, 
X^-superstatistics and inverse superstatistics. 
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I. INTRODUCTION 

Many complex systems in various areas of science ex- 
\ hibit a spatio-temporal dynamics that is inhomogeneous 
and can be effectively described by a superposition of sev- 
eral statistics on different scales, in short a 'superstatis- 
' tics' [H, i, i, H i, i, 0, i, [10, [H ■ The superstatistics 
notion was introduced in [l|, in the mean time many 
applications for a variety of c omp lex swtems have been 

. pointed out [11 m 0, m, [n, M, M, M, [13, [u, [n, m . 

' Essential for this approach is the existence of sufficient 
time scale separation between two relevant dynamics 
within the complex system. There is an intensive param- 
eter (3 that fluctuates on a much larger time scale than 
the typical relaxation time of the local dynamics. In a 
thermodynamic setting, [3 can be interpreted as a local 
inverse temperature of the system, but much broader in- 

\ terpretations are possible. 

The stationary distributions of superstatistical sys- 

\ tems, obtained by averaging over all /?, typically exhibit 
non-Gaussian behavior with fat tails, which can be a 
power law, or a stretched exponential, or other func- 
tional forms as well [3|- In general, the superstatistical 
parameter (3 need not to be an inverse temperature but 
can be an effective parameter in a stochastic differen- 
tial equation, a volatility in finance, or just a local vari- 

] ance parameter extracted from some experimental time 
series. Many applications have been recently reported, 
for example in hydrodynamic turbulence pol. [2^ . [25j , 
for defect turbulence [l2|, for cosmic rays and other 
scatte ring processes in high energy physics [261 i27ll . solar 

\ flares [ij, share price fluctuations [Tsl. [2^.128I129|. ran- 

I dom matrix theory [l^, [H, [s^l, random networks [3l| . 
multiplicative-noise stochastic processes [32.] , wind veloc- 
ity fluctuations [13, [3 , hydro-climatic fluctuations [ll| , 
the statistics of train departure delays [sl] and models 
of the metastatic cascade in cancerous systems [sj] . On 
the theoretical side, there have been recent efforts to for- 
mulate maximum entropy principles for superstatistical 
systems [1, [H [H, [H [11 ■ 
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In this paper we provide an overview over some re- 
cent developments in the area of superstatistics. Three 
examples of recent applications are discussed in some- 
what more detail: the statistics of Lagrangian turbu- 
lence, the statistics of train departure delays, and the 
survival statistics of cancer patients. In all cases the su- 
perstatistical model predictions are in very good agree- 
ment with real data. We also comment on recent theoret- 
ical approaches to develop generalized maximum entropy 
principles for superstatistical systems. 

II. MOTIVATION FOR SUPERSTATISTICS 

In generalized versions of statistical mechanics one 
starts from more general entropic measures than the 
Boltzmann-Gibbs Shannon entropy. A well-known ex- 
ample is the g-entropy [H, [l^] 

i 

but other forms are possible as well (see, e.g., [4l| for a 
recent review). The pi are the probabilities of the mi- 
crostates i, and q is a, real number, the entropic index. 
The ordinary Shannon entropy is contained as the special 
case q = l: 

lim Sn = Si = - 'S^ pi log Pi 

i 

Extremizing Sq subject to suitable constraints yields 
more general canonical ensembles, where the probability 
to observe a microstate with energy Ei is given by 



{l + {q-l)PE,) — 

One obtains a kind of power-law Boltzmann factor, of 
the so-called (/-exponential form. The important question 
is what could be a physical (non-equilibrium mechanism) 
to obtain such distributions. 

The reason could indeed be a driven nonequilibrium 
situation with local fluctuations of the environment. This 
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is the situation where the superstatistics concept enters. 
Our starting point is the foUowing weU-known formula 



1 



where 



/(/?) = 



1 1 ' 



P"-^ ^ exp <^ — 



is the (or T) probabihty distribution. 

We see that averaged ordinary Bohzmann factors with 
distributed /? yield a generalized Boltzmann factor 
of (/-exponential form. The physical interpretation is 
that Tsallis' type of statistical mechanics is relevant 
for nonequilibrium systems with temperature fluctua- 
tions. This approach was made popular by two PRLs 
in 2000/2001 [3 EH. which used the x^-distribution for 
General f{f3) were then discussed in 

In [m it was suggested to construct a dynamical real- 
ization of g-statistics in terms of e.g. a linear Langevin 
equation 



V = —jv + aL{t) 

with fluctuating parameters 7, a. Here L(t) denotes 
Gaussian white noise. The parameters 7, a are supposed 
to fluctuate on a much larger time scale than the 'veloc- 
ity' V. One can think of a Brownian particle that moves 
through spatial 'cells' with different local /3 := 7/(2(t^) 
in each cell (a nonequilibrium situation). Assume the 
probability distribution of /3 in the various cells is a x^- 
distribution of degree n: 



fiP) ~ 



.n/2- 



1 _ 



Then the conditional probability given some fixed /3 in a 
given cell is Gaussian, p{v\(3)) ^ e'"^^"" , the joint prob- 
ability is p{v,(3) = f{P)p{v\P) and the marginal proba- 
bility is p{v) = f{f3)p{v\j3)dj3. Integration yields 



p{v) 



+ 1)1-2)1/(9-1)' 



i.e. we obtain power-law Boltzmann factors with q = 
1 + ;iTT' /3 = 2/?o/(3 - g), and E = ii;^. Here /3o = 
/ f{(3)PdP is the average of /?. 

The idea of superstatistics is to generalize this exam- 
ple to much broader systems. For example, /? need not 
be an inverse temperature but can in principle be any in- 
tensive parameter. Most importantly, one can generalize 
to general probability densities f{(3) and general Hamil- 
tonians. In all cases one obtains a superposition of two 
different statistics: that of (3 and that of ordinary statis- 
tical mechanics. Superstatistics hence describes complex 



nonequilibrium systems with spatio-temporal fluctua- 
tions of an intensive parameter on a large scale. The 
effective Boltzmann factors B{E) for such systems are 
given by 



B{E) 



f{f3)e-P^dp 



Some recent theoretical developments of the super- 
statistics concept include the following: 

• Can prove a superstatistical generalization of fluc- 
tuation theorems Q 

• Can develop a variational principle for the large- 
energy asymptotics of general superstatistics [J] 
(depending on /(/?), one can get not only power 
laws for large E but e.g. also stretched exponen- 
tials) 

• Can formally define generalized entropies for gen- 
eral superstatistics [sT IsBI. [ssj 

• Can study microcanonical superstatistics (related 
to a mixture of g-values) 0] 

• Can prove a superstatistical version of a Central 
Limit Theorem leading to g-statistics Q 

• Can relate it to fractional reaction equations [l^l 

• Can consider superstatistical random matrix the- 
ory [Ii,[2l,[33 

• Can apply superstatistical techniques to networks 

m 

• Can define superstatistical path integrals [B] 

• Can do superstatistical time series analysis 0, 

...and some more practical applications: 

• Can apply superstatistical methods to anal yze the 
statistics of 3d hydrodynamic turbulence |20|. [2^ . 

m 

• Can apply it to atmospheric turbulence (wind ve- 
locity fluctuations [l7l.fl8l|) 

• Can apply superstatistical methods to finance and 
economics [II S [H, El 

• Can apply it to blinking quantum dots [3| 

• Can apply it to cosmic ray statistics 

• Can apply it to various scattering processes in par- 
ticle physics ^26, 27] 

• Can apply it to hydroclimatic fluctuations [l^ 

• Can apply it to train delay statistics ^33,] 

• Can consider medical applications [13] 
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III. OBSERVED UNIVERSALITY CLASSES 



While in principle any is possible in the super- 
statistics approach, in practice one usually observes only 
a few relevant distributions. These are the x^i inverse 
^ and lognormal distribution. In other words, in typical 
complex systems with time scale separation one usually 
observes 3 physically relevant universality classes 

• (^) X^-superstatistics Tsallis statistics) 

• (b) inverse x^-superstatistics 

• (c) lognormal superstatistics 

What could be a plausible reason for this? Consider, 
e.g., case (a). Assume there are many microscopic ran- 
dom variables ^j, j — 1, . . . , J, contributing to /3 in an 
additive way. For large J, the sum ^P" 
proach a Gaussian random variable X\ due to the (ordi- 
nary) Central Limit Theorem. There can be n Gaussian 
random variables Xi , . . . , X„ of the same variance due 
to various relevant degrees of freedom in the system. /3 
should be positive, hence the simplest way to get such a 
positive /3 is to square the Gaussian random variables and 
sum them up. As a result, /3 = X]r=i -^1 X^-distributed 
with degree n. 



/(/?) = 



r(t) V2/3o 



n/2 



V2-1, 



(1) 



where /3o is the average of /3. 

(b) The same considerations can be applied if the 'tem- 
perature' rather than /3 itself is the sum of several 
squared Gaussian random variables arising out of many 
microscopic degrees of freedom ^j. The resulting /(/3) is 
the inverse x^-distribution: 



j3o_ 

r(f) 



2 



n/2 



-n/2-2^ 



"go 
23 , 



(2) 



It generates superstatistical distributions p{E) ^ 

J f{f3)e-P^ that decay as e'^^ for large E. 

(c) [3 may be generated by multiplicative random pro- 
cesses. Consider a local cascade random variable Xi — 
n/=i where J is the number of cascade steps and the 

are positive microscopic random variables. By the (or- 
dinary) Central Limit Theorem, for large J the random 
variable -^logXi — -^X]/=ilog?j becomes Gaussian 
for large J. Hence Xi is log-normally distributed. In 
general there may be n such product contributions to /3, 
i.e., P = n"=i Xi. Then log/3 = Yj1=i ^^gX^ is a sum of 
Gaussian random variables, hence it is Gaussian as well. 
Thus (3 is log-normally distributed, i.e.. 



I3\2 ■ 



/(/?) 



2-Ksf3 



exp ■ 



2s2 



(3) 
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FIG. 1: Observed departure delay statistics on the British 
railway network (data from [S^]). The solid line is a q- 
exponential fit as given by eq. ((5)|. 



IV. APPLICATION TO TRAFFIC DELAYS 

We will now discuss examples of the three different 
superstatistical universality classes. Our first example is 
the departure delay statistics on the British rail network. 
Clearly, at the various stations there are sometimes train 
departure delays of length t. The Oth-order model for the 
waiting time would be a Poisson process which predicts 
that the waiting time distribution until the train finally 
departs is P{t\(3) — (3e~^*, where f3 is some parameter. 
But this does not agree with the actually observed data 
[33| . A much better fit is given by a ^-exponential, see 
Fig. 1. 

What may cause this power law that fits the data? The 
idea is that there are fluctuations in the parameter f3 as 
well. These fluctuations describe large-scale temporal or 
spatial variations of the British rail network environment. 
Examples of causes of these /3-fluctuations: 

• begin of the holiday season with lots of passengers 

• problem with the track 



where fi and s are suitable parameters. 



• bad weather conditions 
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FIG. 2: Typical example of a trajectory of a test particle in 
a turbulent flow. 

• extreme events such as derailments, industrial ac- 
tion, terror alerts, etc. 

As a result, the long-term distribution of train delays 
is then a mixture of exponential distributions where the 
parameter (3 fluctuates: 



p{t) = / nmtma = / fime-^'- (4) 

Jo Jo 

For a x^-distributed /3 with n degrees of freedom one 
obtains 

p(t)^{l + b(q^l)t)^^ (5) 

where q = 1 + 2/(n + 2) and h = 2/3o/(2-g). The 
model discussed in [33| generates g-exponential distribu- 
tions of train delays by a simple mechanism, namely a 
X^-distributed parameter (3 of the local Poisson process. 
This is an example for superstatistics. 



V. APPLICATION TO TURBULENCE 

Our next example is an application in turbulence. Con- 
sider a single tracer particle advected by a fully developed 
turbulent flow. For a while it will see regions of strong 
turbulent activity, then move on to calmer regions, just 
to continue in yet another region of strong activity, and 
so on. This is a superstatistical dynamics, and in fact 
superstatistical models of turbulence have been very suc- 
cessful in recent years [13, HI]. The typical shape of a 
trajectory of such a tracer particle is plotted in Fig. 2. 

This is 'Lagrangian turbulence' in contrast to 'Eule- 
rian turbulence', meaning that one is following a single 
particle in the flow. In particular, one is interested in 
velocity differences u{t) := v{t + t) — v{t) of the particle 
on a small time scale r. For t ^ this velocity dif- 
ference becomes the local acceleration d{t) = u{t)/T. A 



superstatistical Lagrangian model for 3-dim velocity dif- 
ferences of the tracer particle has been developed in [2^ . 
One simply looks at a superstatistical Langevin equation 
of the form 



u ^ —^u + Bn X u + c7L{t). (6) 

Here 7 and B are constants. Note that the term pro- 
portional to B introduces some rotational movement of 
the particle, mimicking the vortices in the flow. The 
noise strength a and the unit vector n evolve stochas- 
tically on a large time scale To- and Tfi, respectively, 
thus obtaining a superstatistical dynamics. is of the 
same order of magnitude as the integral time scale Tl, 
whereas is of the same order of magnitude as the Kol- 
mogorov time scale t^. One can show that the Reynolds 
number Rx is basically given by the time scale ratio 
To7 ~ Tl/t^ ~ R\ » 1. The time scale >> 
describes the average life time of a region of given vor- 
ticity surrounding the test particle. 

In this superstatistical turbulence model one defines 
the parameter f3 to he (3 := 27/(7^, but it does not have 
the meaning of a physical inverse temperature in the flow. 
Rather, one has ^ j^^/^(e)~^/^e, where v is the kine- 
matic viscosity and (e) is the average energy dissipation, 
which is known to fluctuate in turbulent flows. In fact, 
Kolmogorov's theory of 1961 suggests a lognormal distri- 
bution for e, which automatically leads us to lognormal 
superstatistics: It is reasonable to assume that the prob- 
ability density of the stochastic process (3{t) is approxi- 
mately a lognormal distribution 

1 r_(iogA)2] 

For very small t the Id acceleration component of the 
particle is given by ax = u^/t and one gets out of the 
model the 1-point distribution 

_ (8) 

This prediction agrees very well with experimentally 
measured data of the acceleration statistics, which ex- 
hibits very pronounced (non-Gaussian) tails, see Fig. 3 
for an example. 

It is interesting to see that our 3-dimensional super- 
statistical model predicts the existence of correlations 
between the acceleration components. For example, the 
acceleration ax in x direction is not statistically indepen- 
dent of the acceleration ay in y-direction. We may study 
the ratio R := p{ax, ay) / {p{ax)p{ay)) of the joint prob- 
ability p(ax,ay) to the 1-point probabilities p{ax) and 
p{ay). For independent acceleration components this ra- 
tio would always be given by i? = 1. However, our 3- 
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FIG. 3: Measured probability density of small-scale velocity 
differences in Lagrangian turbulence (data from [1^). The 
solid line is a fit of the form ((8} (see [25|] for more details). 




FIG. 4: Predicted shape of correlations as given by eq. ([9}, 
f{0) being the lognormal distribution. 



dimensional superstatistical model yields prediction 



R = 



dp 



(9) 

This is a very general formula, valid for any superstatis- 
tics, for example also Tsallis statistics, obtained when 
f{/3) is the x^-distribution. The trivial result R = 1 
is obtained only for /(/3) = S{(3 — j3o), i.e. no fluctu- 
ations in the parameter f3 at all. Fig. 4 shows R := 
p{ax,ay)/(p{ax)p{ay)) as predicted by lognormal super- 
statistics: The shape of this is very similar to experimen- 
tal measurements [H, Eol . 



VI. APPLICATION IN MEDICINE 

Our final example of application of superstatistics is for 
a completely different area: medicine. We will look at cell 
migration processes describing the metastatic cascade of 
cancerous cells in the body [34]. There are various path- 



FIG. 5: Various pathways for the spread of cancer cells 



ways in which cancerous cells can migrate: Via the blood 
system, the lymphatic system, and so on. The diffusion 
constants for these various pathways are different. In 
this way superstatistics enters, describing different dif- 
fusion speeds for different pathways (see Fig. 5). But 
there is another important issue here: When looking at 
a large ensemble of patients then the spread of cancer- 
ous cells can be very different from patient to patient. 
For some patients the cancer spreads in a very aggressive 
way, whereas for others it is much slower and less aggres- 
sive. So superstatistics also arises from the fact that all 
patients are different. 

A superstatistical model of metastasis and cancer sur- 
vival has been developed in fs^]. Details are described 
in that paper. Here we just mention the flnal result that 
comes out of the model: One obtains the following predic- 
tion for the probability density function of survival time 
i of a patient that is diagnosed with cancer at t = 0: 



Pit) 



'f""iA"e-^* Ao(nAo/2)"/' 



or 



Pit) = 



Tin) 



(nAo)3"/4 



r(n/2) 



-dX, 
(10) 



r(n)r(n/2) 



3n/4-l r 



\/2nXot 



n/2+l 



n/2 



2nXot 
(11 



where Ki,(z) is the modified Bessel function. Note that 
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Cancser-specifle survival time Imontfis) 



FIG. 6: Survival time statistics of breast cancer patients once 
diagnosed with cancer {t = 0), both in a linear and double 
logarithmic plot. Only patients that die from cancer are in- 
cluded in the statistics. The solid line is the superstatistical 
model prediction [33 ]. 



this is inverse superstatistics. The role of the parame- 
ter P is now played by the parameter A, which in a sense 
describes how aggressively the cancer propagates. 

The above formula based on inverse superstatis- 
tics is in good agreement with real data of the survival 
statistics of breast cancer patients in the US. The su- 
perstatistical formula fits the observed distribution very 
well, both in a linear and logarithmic plot (see Fig. 6). 

One remark is at order. When looking at the rele- 
vant time scales one should keep in mind that the data 
shown are survival distributions conditioned on the fact 
that death occurs due to cancer. Many patients, in par- 
ticular if they are diagnosed at an early stage, will live a 
long happy life and die from something else than cancer. 
These cases are not included in the data. 



VII. MAXIMUM ENTROPY PRINCIPLES, 
SUPERSTATISTICAL PATH INTEGRALS, AND 
MORE 

We finish this article by briefly mentioning some other 
recent interesting theoretical developments. 

One major theoretical concern is that a priori the su- 
perstatistical distribution /(/?) can be anything. But 
perhaps one should single out the really relevant distribu- 
tions by a least biased guess, given some constraints 
on the complex system under consideration. This pro- 
gram has been developed in some recent papers (ssl . Issj . 
There are some ambiguities which constraints should be 
implemented, and how. A very general formalism is pre- 
sented in [sl] , which contains previous work [H, HI, [s^l 
as special cases. The three important universality classes 
discussed above, namely superstatistics, inverse su- 
perstatistics and lognormal superstatistics are contained 
as special cases in the formalism of 38]. In principle, 
once a suitable generalized maximum entropy principle 
has been formulated for superstatistical systems, one can 
proceed to a generalized thermodynamic description, get 
a generalized equation of state, and so on. There is still 
a lot of scope of future research to develop the most suit- 
able formalism. But the general tendency seems to be 
to apply maximum entropy principles and least biased 
guesses to nonequilibrium situations as well. In fact, 
Jaynes [i^l always thought this is possible. 

Another interesting development is what one could call 
a superstatistical path integral. These are just ordinary 
path integrals but with an additional integration over a 
parameter (3 that make the Wiener process become some- 
thing more complicated, due to large-scale fluctuations 
of its diffusion constant. Jizba et al. investigate un- 
der which conditions one obtains a Markov process again 
0. It seems some distributions /(/?) are distinguished 
as making the superstatistical process simpler than oth- 
ers, preserving Markovian-like properties. These types of 
superstatistical path integral processes have applications 
in finance, and possibly also in quantum field theory and 
elementary particle physics. 

In high energy physics, many of the power laws ob- 
served for differential cross sections and energy spectra 
in high energy scattering processes can also be explained 
using superstatistical models [l^^^- The key point here 
is to extend the Hagedorn theory [4g| to a superstatistical 
one which properly takes into account temperature fluc- 
tuations [23, iS]. Superstatistical techniques have also 
been recently used to describe the space-time foam in 
string theory [soj . 



VIII. SUMMARY 

Superstatistics (a 'statistics of a statistics') provides 
a physical reason why more general types of Boltzmann 
factors ( e.g. g-exponentials or other functional forms) are 
relevant for nonequilibrium systems with suitable fluctu- 
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ations of an intensive parameter. Let us summarize: 

• There is evidence for three major physically rel- 
evant universality classes: x^-superstatistics — 
Tsallis statistics, inverse x^-superstatistics, and 
lognormal superstatistics. These arise as universal 
limit statistics for many different systems. 

• Superstatistical techniques can be successfully ap- 
plied to a variety of complex systems with time 
scale separation. 

• The train delays on the British railway network are 
an example of superstatistics — Tsallis statistics 
|33]. 

• A superstatistical model of Lagrangian turbulence 



[25| is in excellent agreement with the experimental 
data for probability densities, correlations between 
components, decay of correlations, Lagrangian scal- 
ing exponents, etc. This is an example of lognormal 
superstatistics j25l] . 

• Cancer survival statistics is described by inverse 
superstatistics [34] . 

• The long-term aim is to find a good thermodynamic 
description for general superstatistical systems. A 
generalized maximum entropy principle may help 
to achieve this goal. 
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